Web Survey Bibliography
Relevance & Research Question:
Compared to other survey modes, web-surveys are more easily conducted worldwide. Due to the absence of proper sampling frames, most of these surveys will be volunteer surveys, either inviting respondents from an Internet panel or inviting web-visitors to complete a survey. For the latter ones, there is a three-step selection process, namely through the access to Internet, the interest in the website's topic and the decision to take up the web-survey. While most studies so far analysed selection bias for one or a few countries, this paper firstly explores the nature of selection bias for 28 countries and secondly analyses in how far cross-national differences in the observed selection bias can be attributed to explanations related to Internet access and social and cultural indices.
Methods & Data:
The paper analyses data of the worldwide, continuous, volunteer, multilingual, cross-country comparable WageIndicator web-survey on work and wages. Using the 2010 web-survey data, for the 28 countries of interest, simple weights have been computed for six categories (gender * 3 age groups) using labour force projection data from the International Labour Organisation (ILO). Country-level explanatory variables were taken from Internet Access Tables and from the Indices of Social Development (ISD-database). Besides the usual description of selection biases, multi-level analysis has been applied in order to account for differences within and between countries in an appropriate way.
Results:
Not surprisingly, in almost all countries, the underrepresentation in the survey increases with age. Moreover, in all age groups it is higher for women than for men. Across countries, the ISD “intergroup_cohesion” index correlates negatively with the underrepresentation of women aged 40+ (-0.62) and 30-39 (-.58). The “civic_activism” index only correlates negatively with the underrepresentation of women aged 40+ (-0.44). Surprisingly, the “gender_equality” index does not correlate with women's underrepresentation.
Added value:
Most studies about selection bias have focused on one or a few countries, exploring within-country differences. Thanks to a large number of observations in a large number of countries, this paper adds to the body of knowledge by introducing country-level explanations for differences in response to volunteer web-surveys.
Conference Homepage (abstract) / (full text)
Web survey bibliography - Marketing/business (336)
- Improving the quality of complex surveys: The case of the EU Labour Force Survey ; 2012; van der Valk, J.
- Multi-Language Multi-Continent B2B Community Panel: How B2B research can effectively span the world; 2012; Morden, M., Accomando, E.
- Can Survey Gaming Techniques Cross Continents? Examining cross cultural reactions to creative questioning...; 2012; Puleston, J.
- Research Goes Mobile: Findings from initial smartphone application research; 2012; Dubreuil, C., Joubert, S.
- Probabilistic survey questions and incorrect answers: Retirement income replacement rates; 2012; van Santen, P., Alessie, R., Kalwij, A.
- Mobile Survey Participation Rates in Commercial Market Research: A Meta-Analysis; 2012; Bosnjak, M., Poggio, T., Becker, K. R., Funke, F., Wachenfeld, A., Fischer, B.
- “What a waste of time!” vs “Why not participate?” On sentiments by business...; 2012; Torres van Grinsven, V., Snijkers, G., Daas, P.
- A beginner's guide to DIY research ; 2012; Cates, T.
- The Reliability and Validity of Alternative Customer Satisfaction Measurement Scales in PC Web and Mobile...; 2012; Chrzan, K., Saunders, T.
- The Confirmit Annual Market Research Software Survey 2011; 2012; Macer, T., Wilson, S.
- How Likely?: Comparisons of Behavioral Intention Measurement Validity; 2012; Bremer, J., Thomas, R. K.
- Effects of Progress Indicators on Short Questionnaires; 2012; Sedley, A., Callegaro, M.
- Coverage error in internet surveys Can fixed phones fix it?; 2012; Vicente, P., Reis, E.
- Open-ended Questions in Web Surveys: One Large vs. Ten Small Boxes; 2012; Keusch, F.
- Effects of Pagination on Short Online Surveys; 2012; Sedley, A., Callegaro, M.
- Understanding selection bias in a worldwide, volunteer web-survey; 2012; Tijdens, K., Steinmetz, S.
- Market research online community (MROC) versus focus group; 2012; Zuber, M.
- FamilyVote – Conducting online surveys with children and families; 2012; Geissler, H., Peeters, H.
- The impact of two-stage highly interesting questions on completion rates and data quality in online...; 2012; Hansen, J. M., Smith, S. M.
- Using Webinar Polls to Collect Online Survey Data: The Case of a Behavioral Finance Problem; 2012; Sahu, C.
- Less questions, more data: Revitalizing the european currency in single source affluent audience measurement...; 2011; Hartman, H.
- Gender-specific on-line shopping preferences; 2011; Ulbrich, F., Christensen, T., Stankus, L.
- The Game Experiments: Researching how gaming techniques can be used to improve the quality of feedback...; 2011; Sleep, D., Puleston, J.
- Voice-of-the-customer marketing: A revolutionary 5-step process to create customers who care, spend,...; 2011; Roman, E.
- Unpublisihed internal Google report on break off rates by device type; 2011; Callegaro, M.
- The impact of cookie deletion on site-server and ad-server metrics in Australia. An empirical comScore...; 2011
- State of mobile measurement; 2011; Gluck, M.
- SDSC Announces scalable, high-performance data storage cloud; 2011
- Online survey research: Findings, best practices, and future research. Report prepared for the Advertising...; 2011; Vannette, D.
- Online survey research: Findings, Best practices, and future research; 2011
- New Esomar survey on use of cookies and tracking technologies; 2011
- Latent class analysis of survey error; 2011; Biemer, P. P.
- Just published: Forrester Wave™ of enterprise feedback management satisfaction and loyalty solutions...; 2011; McInnes, A.
- Involve while you evolve. How to make mobile research work for everyone; 2011; Luck, K.
- Harvard research data security policy; 2011
- GRE® program announces big benefits and big savings for GRE® test takers worldwide; 2011
- Going online with assessment; 2011; Burke, E., Mahoney-Phillips, J., Bowler, W., Downey, K.
- Global market research 2011; 2011
- A Survey Stopping Rule Based on Weighting for Unit Nonresponse; 2011; Lewis, T.
- How far is too far: Traditional, flash and gamification interfaces, and implications for the future...; 2011; Puleston, J., Malinoff, B.
- Effects of internet data collection in business surveys – the case of the Dutch SBS; 2011; Giesen, D.
- Apples and oranges: does a web survey produce similar results to social media tracking?; 2011; Bourque, C., Hobbs, R., Hilaire, D. S.
- Mixed methods designs in marketing research; 2011; Harrison, R. L., Reilly, T. M.
- Reflections on web based data collection in a mixed mode design: the case of the EU Labour Force Survey...; 2011; Kloek, W., van der Valk, J.
- Mobile Research Apps – Adding New Capabilities to Market Research; 2011; Rieber, D.
- Capturing affective experiences using the SMS Experience Sampling (SMS-ES) method.; 2011; Andrews, L., Russell-Bennett, R., Drennan, J.
- Quantifying Open-Ended Responses: Results from an Online Advertising Tracking Survey; 2011; Jacobe, A., Brewer, L., Vakalia, F., Turner, S., Marsh, S. M.
- Dissemination of survey (meta)data in the LISS data archive; 2011; Streefkerk, M., Elshout, S.
- Underreporting in Interleafed Questionnaires: Evidence from Two Web Surveys; 2011; Medway, R., Viera Jr., L., Turner, S., Marsh, S. M.
- A mixed mode pilot on consumer barometer; 2011; Taskinen, P., Simpanen, M.